APPLYING METRIC REGULARITY TO COMPUTE A CONDITION 
MEASURE OF A SMOOTHING ALGORITHM FOR MATRIX GAMES 

BORIS S. MORDUKHOVIClfl JAVIER F. PENAEI and VERA ROSHCHINAEI 
Abstract. We develop an approach of variational analysis and generalized differentiation to condi- 
tioning issues for two-person zero-sum matrix games. Our major results establish precise relationships 
between a certain condition measure of the smoothing first-order algorithm proposed by Gilpin et al. [Pro- 
ceedings of the 23rd AAAI Conference (2008) pp. 75-82] and the exact bound of metric regularity for an 
associated set-valued mapping. In this way we compute the aforementioned condition measure in terms of 
the initial matrix game data. 

f^ . Key words, matrix games, smoothing algorithm, condition measure, variational analysis, metric 

rsj ■ regularity, generalized differentiation 



> 

o 



C3 



- I - 1 

>< 



AMS subject classifications. 90DI0, 90C30, 49J53, 49J52, 49M45 
Abbreviated title. Condition measure for matrix games 



1. Introduction and formulation of main results. This paper is devoted to applications 
of advanced techniques in variational analysis and generalized differentiation to the study of con- 
ditioning in optimization. Our specific goal is to apply the key notions and generalized differential 
characterizations of Lipschitzian stability and metric regularity, fundamental in variational analy- 
(■h | sis, to computing a certain condition measure of the first-order smoothing algorithm proposed in 

[3] to find approximate Nash equilibria of two-person zero-sum matrix games. 

To the best of our knowledge, applications of Lipschitzian stability and metric regularity to 
numerical aspects of optimization were initiated by Robinson in the 1970s; see, e.g., |17) and the 
references therein. In the complexity theory, Renegar |15[ I16j established relationships between 
£NJ ' the rate of convergence of interior-point methods for linear and conic convex programs and their 

"distance to ill-posedness" and related condition numbers. We refer the reader to [Tl 121 [51 161 171 [Tl] 
and their bibliographies for more recent results in this direction for various algorithms in convex 
I | and nonconvex optimization problems. 

In [3], a new condition measure was introduced to evaluate the complexity of a first-order 
£~^. ■ algorithm for solving a two-person zero-sum game 

o. 

^D . min max a; Ay = max min x Ay, (1-1) 

where A S M mxn , where the symbol T stands for transposition, and where each of the sets Q\ 
and Q2 is either a simplex (in the matrix game formulation) or a more elaborate polytope (in the 
case of sequential games). Problems of this type arise in many interesting applications; see, e.g., 
fH HE EH H3] and the references therein. 

It was shown in [4] that an iterative version of Ncsterov's first-order smoothing algorithm [TTJ 
ll~2] computes an e-equilibrium point (in the sense of Nash) for problem (|1.1[) in C(||A||k(A) ln(l/e)) 
iterations, where k(A) is a condition measure of (|1.1[) depending only on A; see (|1.7|) for the 
definition of the condition measure k(A) in the case of matrix games. The dependence of this 
complexity bound on e is exponentially better than the complexity bound 0(1/ e) in the original 
Nesterov's smoothing techniques. Furthermore, it was proved in [4] that the condition measure 
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k(A) is always finite while the proof therein was non-constructive. In particular, no explicit upper 
bound on k(A) was given. However, numerical results reported in [1] clearly demonstrate that the 
developed iterative version of Nesterov's smoothing algorithm is faster than other algorithms known 
in this setting and that this version exhibits at least linear convergence for a random collection of 
the problem instances considered in [4]. This allows us to treat the number k(A) as a condition 
measure of the algorithm and evaluate it in what follows. 

In this paper we focus on the matrix game equilibrium problem 

min max x Ay = max min x Ay, (1-2) 

i€A m yGA„ yeA„ i£A m 

where the m-dimcnsional simplex 

m 

A m := Ix G R m \ '^x l = 1, x > o} 

i=\ 

describes the set of mixed strategies for the x-playcr (Player 1) with m pure strategies; similarly 
for the y-player y G A„ (Player 2). This means that if Player 1 uses x G A m and Player 2 uses 
y G A„, then Player 1 gets payoff — x T Ay while Player 2 gets payoff x T Ay. Thus the equilibrium 
problem (|1.2|) can be reformulated as the following problem of nonsmooth convex optimization: 

minimize F{x,y) subject to (x, y) G A m x A„, (1-3) 

where the minimizing cost function F(x, y) is defined by the maximum 

F(x,y) := ma,yi{x T Av - u T Ay\ (u,v) G A m x A„}. (1.4) 

It is easy to observe that 

mm{F(x, y)\ (x, y) G A m x A n } = 0. (1.5) 

Taking (|1.5|) into account, we say [JM33] that a feasible pair (x, y) G A m x A„ is a Nash equilibrium 
to (|1.2|) if F(x,y) = 0, which corresponds to an optimal solution of the constrained optimization 
problem (| 1 .3[) . Consider the optimal solution set 

S := {(x,y) G A m x A„| F(z,y) = 0} = F'^O) n (A m x A„) (1.6) 

and, following 4 , define the condition measure k(A) of the matrix game (|1.2p depending on the 
underlying matrix A via the objective (|1.4p and the optimal solution set (|1.6|) as 

k{A) := inf {k > | dist ((», y); 5) < kF(x, y) for all (a;, y) G A m x A„} , (1.7) 

where dist (•; S) stands for the standard Euclidean distance function. 

In what follows we derive three major results concerning the characterization of the condition 
measure k(A) in (|1.7[) . The first theorem shows that the condition measure k(A) precisely relates 
to the exact bound of metric regularity for an associated set-valued mapping built upon the cost 
function fll.4p . The second result expresses this exact regularity bound via the subdiffcrcntial of 
the convex function (| 1 .4|) and the normal cone to the simplex product A m x A„ and then computes 
the latter constructions in terms of the initial data of (jl.2p . Finally, we arrive at an exact formula 
for evaluating k(A), which is a key step towards performing further complexity analysis of the 
algorithm 0]. 

To formulate the first theorem, define a set- valued mapping $ : M m+n =4 M by 

[F(x,y), oo) if (x, y) G A m X A„, 
${x,y):={ (1.8) 

) otherwise 



via the cost function F constructed in (jl.41) . Let rcg$ ((x,y),F(x, y)) be the exact bound of 
metric regularity (or the exact regularity bound/modulus) of the mapping $ around the point 
{(x,y),F{x,y)) G gph$; see PJJ1 Qj|]. For the reader's convenience we recall these concepts in 
Section 2 below. 

Theorem 1.1. (condition measure via the exact regularity bound). Assume that 
(A m x A n ) \ 5* 7^ with S defined in (jl.61) . Then we have the precise relationship 

k(A)= sup reg$((x,y),F(x,y)) (1.9) 

(z,y)e(A m xA„)\S 



between the condition measure (|1.7|l and the exact regularity bound of (|1.8j) . 

Our second major result gives a complete characterization of metric regularity for the set- 
valued mapping $ defined in (|1.8|) . 

Theorem 1.2. (computing the exact bound of metric regularity). For any point 
(x,y) G (A m x A n ) \ S, the exact regularity bound of the mapping $ from (|1.8j) around the point 
({x,y),F(x,y)) admits the representation 

reg$((x, y),F(x,y)) = -, ; ; ; rv (1.10) 

6 VV >V), V ,yj) d ist(0- 1 dF(x,y) + N AmXAn (x,y)) V ! 

via the subdifferential of the convex function (|1.4[) and the normal cone to the simplex product 
A m x A„ at (x,y). 

Unifying the results of Theorem ll.ll and Thcorcm ll.2l and then explicitly computing the subdif- 
ferential and normal cone on the right-hand side of (|1.10|) , we get the precise formula for computing 
the condition measure of the smoothing algorithm for matrix games as stated in Theorem l 1 . 3l below. 
To formulate this third major result, we introduce some convenient notation. Let aj as i = 1, . . . , n 
and —b]; as k = 1, . . . , m stand for the columns and the rows of the matrix A, respectively. By ej, 
j = 1, . . . , m + n, we denote the unit vectors in M m+n , i.e., 

(ej); = for all / =/= j and (ej)j = 1 as j = 1, . . . , m + n. 

For a positive integer p, let l p := [l ... l] G M p . Finally, given a feasible point (x,y) G 
A m x A n , define the index sets I(x),K(y), and J(x,y) by 



I(x) :— \i G |1, . . . ,n\ aj x — max a,x>, 
I l ie{i,...,n} J 

K(y) :={fcG {l,...,m} b\y = mw ft), ( L11 ) 

•/(a:,y) := {j G {l,...,m}| Xj = 0} 1J {j = m + p| j/ p = 0}. 

Theorem 1.3. (computing the condition measure). Let (A m x A„) \ S ^ 0. Then, in 
the notation above, the condition measure k{A) defined in (|1.7|) is computed by 



(i,s)e(A m xA„)\s 



k(A) = sup dist (0;co {(ai,&fe)| i G /(x), fc G if(j/)} 

t-span{l m } x span{l„} — cone [co {ej| j G J(x,y) 



where the symbols span, cone, and co stand respectively for the linear, conic, and convex hulls of 
the sets in question. 

The proofs of Theorem 11.11 and Theorem 11.21 given below are based on applying advanced 
techniques of variational analysis and generalized differentiation. This approach leads us therefore 
to deriving the precise formula for the condition measure in Theorem l 1.31 For additional insight, we 
also present a direct, independent proof of the latter theorem relying on more conventional while 
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somewhat more laborious techniques of convex optimization employing particularly Lagrangian 
duality. 

Remark 1.4. (numerical implementation and further research). Numerical imple- 
mentation of the formula for the condition measure in Theorem 11.31 is not a purpose of this paper 
and in fact is not an easy job. It has been well recognized in complexity theory that evaluating 
condition measures may be in general as difficult as to solve the original problem. This is true, 
e.g., in the cases of such fundamental complexity measures as the condition number of a matrix 
[5] used in estimating complexity of numerical linear algebra algorithms, Renegar's condition num- 
ber [14] [15] [16] that characterizes difficulty of solving conic feasibility problems, the "measure of 
condition" for finding zeros of complex polynomials introduced by Shub and Smale [21) . etc. 

The main purpose of this paper is not obtaining an easily computable expression for the 
condition measure k(A), but rather gaining a better understanding on how exactly the problem 
data influence the condition measure. Observe that the formula for k(A) obtained in Theorem 1 1.31 
is much easier to evaluate and analyze than the original construction (| 1 . T|) . This is valuable for 
the average-case and smoothed analysis of the algorithm, singling out classes of well-conditioned 
problems, preconditioning issues, and making further improvements to the algorithm. We will 
pursue these goals in our subsequent research. 

The rest of the paper is organized as follows. In Section [5] we recall some basic definitions and 
facts of variational analysis and generalized differentiation crucial for deriving the main results of 
the paper. Section[3]is devoted to variational proofs of the main results formulated above. Finally, 
in Section 0] we present an alternative direct proof of Theorem 11.31 by employing tools of convex 
optimization. 

Throughout the paper we use standard notation and terminology of variational analysis; see, 
e.g., the basic texts [TUI [T9"] . 

2. Preliminaries from variational analysis and generalized differentiation. Here we 

confine ourselves to finite-dimensional Euclidean spaces sufficient for the subsequent applications. 
The reader is referred to [TOl [19] for more details and related material. 

Given a set-valued mapping G: M" =^ M m , consider its inverse G _1 : TR m =£ M n with x £ 
G~ l (z) <=>• z £ G(x) as well as its graphs, domain, and range defined respectively by 

gphG:={(x,z)\ z£G(x)}, domG := {x\ G(x) ^ 0}, rgeG := domG" 1 . 

The notion of metric regularity is of primary interest in our development. 

Definition 2.1. (metric regularity). A set-valued mapping G: M n =^ M n is metrically 
regular around (x,z) £ gphG with modulus \i > if there exist neighborhoods U of x and V of 
z such that 

dist (x; G~ l {z)) < /idist (z; G(x)) whenever x £ U and z £ V. (2-1) 

The infimum of \x > over all (/i, U, V) for which (|2.1[) holds is called the exact regularity 
BOUND of G around (x,z) and is denoted by regG(x, z). 

It is well known in variational analysis that the fundamental property of metric regularity is 
closely related to Lipschitzian behavior of inverse mappings. Recall that a mapping G: JR n =£ M m 
is Lipschitz-like (or has the Aubin property) around (x, z) £ gph G with modulus t > if there are 
neighborhoods U of x and V of z such that 

G(x) nl/C G{u) + £\\x - u\\B for all x,u€U, (2.2) 

where IB stands for the Euclidean closed unit ball of the space in question. The infimum of £ > 
over all the combinations (£, U, V) for which (|2.2p holds is called the exact Lipschitzian bound of 
G around (x, z) and is denoted by lipG(x, z). 

The following result can be found, e.g., in [TU1 Theorem 1.49]. 

Proposition 2.2. (relationships between metric regularity and Lipschitz-like prop- 
erties). Let G: lR n =£ IR m , and let (x,z) £ gphG. Then the mapping G is metrically regular 
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around (x,z) if and only if its inverse G : lR m =£ M n is Lipschitz-like around (z,x). Further- 
more, we have the equality 

regG(x, z) = lipG~ (z, x). 



One of the key advantages of modern variational analysis is the possibility to completely charac- 
terize Lipschitzian and metric regularity properties of set- valued mappings in terms of appropriate 
generalized differential constructions enjoying full calculus. Let us recall such constructions used 
in this paper. 

Given a nonempty subset $7 C JR n and a point x £ O, define the Frechet /regular normal cone 
to fl at x by 



N n (x) :={v£ M n 



v (v,x~x) 

hm sup -r. rrr- < 

n_ \\x — x\\ 



i> 



where the symbol x — > x means that x — > x with igfl. Then the Mordukhovich (basic/limiting) 
normal cone to f2 at x £ O is defined by 

Nq(x) := Limsup J\fo(x), (2.3) 

n _ 
x—tx 

where 'Limsup' stands for the Painleve-Kuratowski outer/upper limit of a set- valued mapping 
M : M n =4 M m given by 



Limsup M(x) :=[»£«" 



3 Xk — > x, Vk — > v as k — > oo such that 
v k eM(x k ) for all k = M := {1,2, . . .}}. 



If the set il is locally closed around x, the normal cone (|2.3|) admits the equivalent description 
(which was in fact the original definition in [5]) 

Nq(x) — Limsup [cone (x — Iln(x))] 

X— ¥X 

in terms of the projection operator IIq(x) := {y £ fl\ \\y — x\\ = dist (x; f2)}. 

Note that the normal cone (|2.3p may be nonconvex even for simple sets f2 C M n , e.g., for 
the graph of |x| and the epigraph of — |x| at (0,0). Due to its nonconvexity, the normal cone 
(|2.3|) cannot be polar to any tangent cone. Nevertheless, this nonconvex normal cone and the 
corresponding subdiffcrcntial/coderivative constructions for extended-real- valued (i.e., with values 
in (—00,00]) functions and set- valued mappings satisfy comprehensive calculus rules, which are 
derived by using variational arguments, particularly the extremal principle of variational analysis; 
see [TQl [19] and the references therein. 

A set f2 is called normally regular at x G 51 if iVfj(x) = Nq(x). The class of normally regular 
sets covers "nice" sets having a local convex-like structure. A major example is provided by convex 
sets; see, e.g., [TU1 Proposition 1.5]. 

Proposition 2.3. (normal regularity of convex sets). Let fl C M n be convex. Then it 
is normally regular at every point x € f2, and its normal cone (|2.3|) reduces to the normal cone in 
the sense of convex analysis: 

Nq(x) = {v £ M n \ (v,x- x) < for all x £ 0}. 



Given next a set-valued mapping G: JR n =^ M m and a point (x,z) G gphF, define a gener- 
alized derivative of G at (x, z) induced by the normal cone (|2.3[) to gphG at (x, z). Namely, the 
coderivative of G at (x, z) is a set-valued mapping D*G(x, z) : M m =4 -K n with the values 

D*G(JM)(w) := {u G M n \ (u,-v) G ^ gphG (S,z)}. (2.4) 

Observe that G D*G(x,z)(0) and D*G(x,z)(Xv) = XD*G{x,z)(v) for every A > 0, i.e., the 
coderivative ()2.4j) is a positively homogeneous mapping. If G: M n — > M m is single- valued and 
smooth around x with the derivative VG(x), we have (see, e.g., by [THl Theorem 1.38]) 

D*G(x)(v) = {VG(x) t d} for all v G JT\ 

The latter signihcs that the coderivative (|2.4[) is an appropriate extension of the adjoint /transpose 
derivative operator to the case of nonsmooth and set- valued mappings. Note also that, by the non- 
convexity of the normal cone (|2.3[) , the coderivative (|2.4I) is not dual to any tangcntially generated 
graphical derivative, except of the case when G is graphical regular at (x, z) meaning that 

gphG*' 2 '' z > = gphG'- 3 '' z >' 

As mentioned above, the coderivative (|2.4|) satisfies comprehensive calculus rules for general 
set-valued mappings. In this paper we only need the following one, which is a consequence of [101 
Proposition 3.12]. To formulate it, recall that the indicator mapping Sq : M n — » M of a set £1 C M n 
is defined by 

„ , . JO if x G O, 
On (a; J : ~ \ otherwise, 

(a bit different from the indicator functions) and that we easily have the relationship 
D*(5q)(x)(v) = Nq(x) for any x G VL and u G M. 

Proposition 2.4. (coderivative sum rule). Let fi c JR n be locally closed around x G fi, 
and Zei G: M n ^ 1R be closed-graph and Lipschitz-like around (x, z) G gphG. Then for all v G 1R 
we have the inclusion 

D*{G + 5a)(x, z)(v) G D*G{x, z)(v) + N a (x), 

which holds as equality if £1 is normally regular at x and F is graphically regular at (x,z). 

In what follows we employ the norm of the coderivative as a positively homogeneous mapping. 
The norm of a positively homogeneous mapping M : M n =$ M m is defined by 

\\M\\ :=sup{||u|| \uGM(v) with ||v|| < 1} 

and admits (by passing to the inverse) the useful distance function representation below established 
in [3J Proposition 2.5]. 

Proposition 2.5. (norm of positively homogeneous mappings). Let M: M n ^ M m 

be positively homogeneous. Then the norm of its inverse is computed by 

Hiir 1 !) = sup 



Hl=i 



dist (0; M(v)) 



The final and most important result presented in this section provides a complete coderivative 
characterization of the Lipschitz-like property (known as the Mordukhovich criterion |19j ) with 
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computing the exact bound of Lipschitzian moduli; see [9J Theorem 5.7], [TU1 Theorem 4.10], and 
[TO1 Theorem 9.40] for different proofs. 

Theorem 2.6. (coderivative characterization of the Lipschitz-like property for set- 
valued mappings). Let G: M m =$ M n be closed-graph around (x,z) £ gphG. Then G is 
Lipschitz-like around this point if and only if D*G(x,z)(0) = {0}. In this case 

\ipG(x,z) = \\D*G(x,z)\\. 



3. Proofs of main results. We give here complete proofs of Theorem 11.11 and Theorem II. 21 
and thus derive the condition measure formula of Theorem II .31 by variational arguments. 

Let us start with the proof of Thcorcm ll.il To proceed, we first establish a more convenient 
representation of the condition measure (|1.7|) for our further analysis, which in turn is preceded 
by a technical claim. 

Observe that the function F(x,y) defined by (|1.4[) can be written as follows: 

F(x,y) = max (a i x + bjy). 

i = 1, . . . ,n 

j = l,...,m 
In addition we represent the simplex product A m x A„ by: 



A m x A„ = {iu = (x, y) | w > 0, Ew = /} with E := 



1 T 

ill 







1 T 



and / := 



maxci w, 



To simplify notation, rewrite the function F as 

F(w) = 

where L := {1, . . . , ?i} x {1, . . . , m} and cj 

il := A„ x A m = {w | w > 0, £w = /} and rewrite (|1.7p as 

fc F := inf {fc > 0| dist (w; S) < kF(w) for all w £ 0} 



[a^ 6 J] for each ^ = (i,j) G L. Denote further 



(3.1) 

with S given by (|1.6p . Observe that minn F(x) = by (jl.5[) . It is also convenient for us to define 
the moving sets 



S(z) := {w G 0| F(w) = z]= F~ l {z) C\ with thus S = 5(0) 
and to represent the mapping $ in (|1.8j) and its inverse by 

$(iu) = [F(u;), oo) + Sn(w) and $ _1 (z) = {w G fi| F(io) < z}. 



(3.2) 



(3.3) 



Let us finally denote J := {1, . . . , n, n + 1, . . . , m + n} and define the corresponding counterparts 
of the index sets /(•) and J(-) from (|l.lll) given by 



l(w) := {I G L\ cjw = F(w)}, J(w) := {j G j\ 



0}. 



It is not difficult to verify the following technical claim, where 1B 1 stands for the closed ball 
of radius 7 > centered at the origin. 

Claim 3.1. (relationships between index sets). For every w G ft there exists 7 > such 
that X(w) C 1(w) and J{w) C J{w) whenever w G w + 1B~. Proof. Fix an arbitrary element 
w G £1 and let 



< 7 < min ' 



1 



e e L ^ 2||q|| i£L\i(w) 
7 



min_ (F(w) -qw). 



3dJ\J{w) 



where min0 — oo by convention. It is easy to observe that such a number 7 always exists. When 
I(w) = L, the inclusion I{w) C I(w) is obvious. Assume thus that L \ X(w) ^ 0. For every 
£q G L \ I(w) and every w G w + IB^ we have 

cj w = cjw + cj (w -w)< cj w + ||q ||7 < cjw + - min (F(w) - cjw), 

Z ££L\X(w) 

which implies the relationships 

max (c f w) < max (c f w) -\ — min (F(w) — c f w) 

ieL\x(w) teL\i{w) 2e&L\x(w) y ' 

(3.4) 

= - I F(w) + max cjw 
2 V ieL\i(w) 

Similarly, for every £0 S I(w) we have 

C J W = c l w + C J ( W ~w)> cj o w - ||q ||7 > cJ o w - - min (F(w) - cjw), 

which in turn implies that 

max (cp w) > max (c f w) min (F(w) — c f w) 

iei(w) eex(w) 2eeL\x(w) y ' 

= max (cjw) - -F(w) + - max (cjw) (3 5) 

iei(w) 2 2 i£L\i(w) y ' 

= o F ( tD ) + . Vl 2 ^ (cjw) 

2 \ l&L\X{w) 

where the last step follows by the construction of I(w). Combining (|3.4[) and Q3.5J) gives us the 
strict inequality 

max (c f w) — max (c t w) > 0, 

iel(w) leL\X(w) 

and hence justifies the first claimed inclusion X(w) C I(w). 

It remains to show that J(w) C J{w) for all w G W+1B 7 . The latter inclusion is obvious when 
J{w) = J . Assume now that J \ J(w) ^ and then get for every w G w + IB-y and j £ J \ J(w) 
the relationships 

Wj = Wj + Wj — Wj > uij — 7 > uij — min uij > 0. 

jeJ\J(w) 

Thus Wj > whenever j <E J \ J(w), and thus we arrive at J(w) C J(w). A 

The next result provides a useful representation of the condition measure ([3.1 [I convenient for 
our subsequent analysis. 

Lemma 3.2. (representation of condition measure). Assume that il\S ^ 0. TTien t/iere 
exists us <E Q,\S such that 

dist (w; 5) dist (w; S 1 ) 
fc F = sup — — - — = — —— - — . (3.6) 

wen\s F ( w ) F ( w ) 

The proof of Lemma 13.21 is based on dividing the set ft \ S into a finite family of subsets and 
showing that the supremum is attained on each one of such sets. Before presenting this proof, we 
introduce some notation and prove a technical proposition. 



For every s £ S let Ns{s) be the normal cone to S at s. Observe that this cone is polyhedral 
and can be represented as follows: 

N s {s) = {g = w-s\ dist (w;S) = \\w-s\\}. (3.7) 

Also for every s £ S define 

K s :=nn(s + N s (s)). 

Note that for every s £ S the set K s is a convex polytope and that 

n = U K, and n \ S = |J (A s \ {s}) . 

ses ses 

In addition, it follows from (|3.7[) and the definition of A s that for every s £ S and any w £ K s we 
have 

dist (lyjS 1 ) = ||w-s||. 

Proposition 3.3. (supremum attainability). For every s £ S there exists w £ K s \ {s}, 
which realizes the supremum 

dist (w; S) dist (w; S) 

Proof. Let s £ S, and let a sequence {wk} C A' s \ {s} be such that 

dist (w; S) \\w-s\\ \\w k - s\\ 

sup — - — = sup — — = lim 



»6K,\{.} F(w) weK s \{s} F(w) k^oo F(w k ) 

Without loss of generality it can be assumed that Wk — > wq £ K s along the whole sequence {wk}, 
since K 8 is closed and bounded. If w ^ s, we get F(w a ) ^ and thus 

,. \\wk-s\\ \\w -s\\ 
lim 



fc^oo F{wk) F(w ) 



Therefore, in this case we have found w — wq that satisfies ([37 

In the case when wq = s, consider the sequence {gk} defined by 

9k ■= , Wfc ~ S „ for all k £ IV. 
\\Wk - s\\ 

Since {gk} is bounded, suppose without loss of generality that gk — >• .9 with ||g|| = 1. The 
polyhedrality of K s implies the existence of Ai > satisfying s + Xg £ A s for all A £ [0, Ai]. 
Further, the finiteness of the index set L allows us to get without loss of generality that 

I(wk) =lo Cl for all k. 

Then there exists Iq £ Xq such that 

cj Wk > cjwk whenever I £ L and k £ W. (3-9) 

Since Wk — > s, we have for all I £ L that 

„t„„ _ T 



lim Cj Wk = C; s, 



which by (|379]l yields that Z & l(s). 



Let us show in addition that there is A2 > for which Iq G I(s + Xg) whenever A S [0,A2]. 
Indeed, assume the contrary and find a sequence {A^"'- 1 } with A 1 -™' 4. such that Iq £ Z(s + X^g) 
for all m £ IN. Then without loss of generality (since L is finite) there exists I £ L satisfying 

cj(s + A (m) 5 ) > cj (s + A (m) 5 ) for all m £ N. 

By the same arguments used above to show that ^0 £ ^(s), we get I £ I(s) and thus 

C t s = c t, s = 0. (3.10) 

Together with (|3.9|) . the latter yields that 

T (w fc - s) T (w fc - s) 
Cl " \\w k - s\\ - C < \\w k - s\\ ■ 

By passing to the limit as k — > 00, we obtain cj g > cjg and conclude that 

^( s + aH 5 )>^( s + aH s ), 

which contradicts our assumption and thus justifies the claim. 

To proceed further, denote A := min{Ai, A2} and w := s + Xg. Then we have 



dist (w; 


S) \\w-s\\ 


Allflll 

Xc la 


= 


1 
— T ' 

%9 




F(w) 


F(w) 




But it follows at the same time that 












,. \\w k -s\\ 
hm — = 

fc-s-oo F(Wk) 


hm ll ^- S " 
fc ^°° c i w k 


= lim -=- 

fe— >oo c, ■ 

'0 


1 

w k —s 

\\ w k-s\\ 


1 

— T 
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which shows that w satisfies (|3.8|) and thus completes the proof of the proposition. A 

Now let us justify our basic Lemma 13.21 
Proof of Lemma 13.21 For every s £ S consider the tangent cone to £1 at s defined by 

Ta(s) := {g £ M n \ 3a > : s + ag £ for all a £ (0,a ]}. 

We split the set S into a family of disjoint subsets S, which correspond to the following equivalence 
classes: 

81 ~ s 2 if and only if N s { Sl ) = 7V s (s 2 ), T n (ai) = Tq(s 2 ), and dF{si) = dF{s 2 ). 

Observe the relationship 

d(w,S) d(w,S) 

SU P Wi \ = SU P SU P SU P zpf \ ' ( 3 - n ) 

where the outer suprcmum (over C £ S) on the right-hand side is attained, since the number of 
different sets/classes in S is finite due to the polyhedral structure of the problem. The innermost 
supremum in p. lip is attained by Proposition 13.31 Hence to prove the claim, it remains to show 
that the supremum over s £ C in p. lip is also attained. We do it by proving that for every C £ S 
it holds 

d(w,S) d(w,S) , . 

sup — — - — — = sup — —. — r— whenever si,S2<GG. (3-12) 

weK 31 \{si} *\w) weK 32 \{s 2 } r(yj) 
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To proceed, pick an arbitrary set C £ S and arbitrary elements S\,S2 G C. Fix a point 
wq G -K" Sl \ {s\} and get by the definition of K Sl the corresponding point g := wq — s% G Ns(s\). 
Since Ns(si) = Ns(s2) and since Ns(s2) is a cone, we have 

A.g G N s (s 2 ) for all A G [0,oo). 

It follows again from the definition of K s and from the polyhcdrality of CI that g G Tq(s\) and 
hence 5 G Th(s 2 ) by Xh(si) = Tq(s 2 ). This ensures the existence of Ai > such that S2 + Xg G Cl 
for all A G [0,Ai]. Thus 

S2 + \genn( S 2 + N s (s2))\{s2} = K S2 \{ S 2} for all Ag(0,Ai]. 

Since F is polyhedral, it follows that for each point s in S the function F(-) — F(s) is positively 
homogeneous in a neighborhood of s, and therefore it can be represented in this neighborhood via 
the subdifferential of F as 

F(w) — F(s) = max v (w — s). 

vedF(s) 

Since dF(si) = 8F(a 2 ), find A 2 > such that F(si + Xg) = F(s 2 + Xg) for all A G [0, A 2 ]. Letting 
further A := min{Ai, A2} and denoting w\ := Si + Xg G K Sl and W2 '■= 52 + Xg G K S2 , we have 
F(wi) — F[w2) and 

F(wi) = F(si + Xg) = F((l - X)s x + Xw Q ) < (1 - A)F(si) + AF(w ) = AF(w ) 

by the convexity of F. This implies the relationships 

dist(iu 2 ;S) _ dist(wi;S*) _ ||A.g|| A||g|| _ dist (w ; S) 



F{w 2 ) F(wi) F(wi) ~ XF(w ) F{w ) 

Since the latter holds for any w G K S1 \ {si}, we get 

dist O; S) dist (w; S) 

sup — ^r~\ — - sup — ^r~\ — ■ ( 3 - 13 ) 

weK S2 \{s 2 } fi(W) w£K sl \{ Sl } J"(W) 

The inverse inequality to p,13p is obtained by interchanging the roles of si and S2- Since our initial 
choice of C G S and si, s 2 G C was arbitrary, we arrive at the equality in p,12j) for all C G S and 
thus complete the proof of the lemma. A 

Now we are ready to prove our main results, namely Theorem ll.l[ Theorem 11.21 and Theo- 
rem 11.31 



3.1. Proof of Theorem 11.11 We split the proof of the theorem into three major steps. 

Step 1: metric regularity via condition measure. For every w ^ S and every z > we have 
the distance estimate 

dist^;*" 1 ^)) < fc F dist($(w);z). (3.14) 

Proof. When w £ CI, the right-hand side of (|3.14j) becomes infinity (by the construction of $ in 
(|3.3[) and the standard convention on inf = 00) while the left-hand side is finite, i.e., there is 
nothing to prove. Considering the case of w G CI, observe that the left-hand side of (|3.14p becomes 
zero when F(w) < z, and thus the inequality holds automatically. It remains to examine the case 
when < z < F(w) with w E CI. 

To proceed, let w* := H^-i^){w), and observe that F(w*) = z, since otherwise the continuity 
of F would allow us to find a closer point to w in [w* , w] D $ _1 (z). Thus 

dist (w; $ _1 (*0) = dist (w; S(z)) = \\w -w*\\, (3.15) 
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where S(-) is defined in (|3.2[) . Let wq '■= Tls(w). Employing again the continuity of F, we find 
A 6 (0,1) such that 

F(w a + X(w - w )) = z. (3.16) 

In addition the convexity of F yields that 

z = F(w + X(w - w )) < F{w ) + X(F(w) - F(w )) = XF(w). (3.17) 

Combining the above, we have the relationships 

dist (w; $ _1 (*)) = dist {w\ S(z)) ( by (l3~T5l) ) 

< \\wo+X(w-Wo)-w\\ (bv (I3TTC)) ) (3.18) 

= (1- X)\\w -w\\ = (1 -A) dist (w;S); 

dist ($(w); z) = F(w) - z ( as z < F(w)) 

> F(w) - XF(w) ( by (l3~T7D ) (3.19) 

= (l-A)F(ttf), 

which finally give 

dist^;*- 1 ^))) < (1 - A) dist (w; S) ( bv (l3~T8l) ) 

< (1 - X)k F F(w) ( as dist (iD; 5) < k F F(w)) 

< k F dist (*(u)); z) ( by (|3~T9l> ) 

and thus allow us to arrive at (|3.14p . A 

Step 2: distance properties. Let w £ £l\S be such that 

dist (w; S) 

k F = ^—, — , (3.20) 

b (w) 

let wo '■= Tls{w), and for X € (0, 1) let 

w\ := w + X(wo — w). 

Then for any X £ (0,1) we have the properties: 
(i) F(w x ) = (1 - X)F(w). 
(ii) dist^;*- 1 ^^))) = Adist (w; S). 
Proof. To justify (i), observe that by the convexity of F we have 

F(w x ) < F(w) + X(F(w ) - F(w)) = (1 - X)F(w) (3.21) 

in the notation above. On the other hand, the definition of k F and the choice of w yield 

> dist (w x ;S) = (1-A)||u)-^|| = (1 -A) dist (a; S) = 
k F kp kp 

Thus assertion (i) follows from (|3~2T|) and ((3~2"2"j) . 
To justify (ii), it suffices to show that 

dist (w; ^>- 1 (F(w x ))) = \\w - w x \\. 

Proceeding by contradiction, assume that dist (w; &~ 1 (F(w x ))) < X dist (w;S) = Xk F F(w) and 
let w* := Tls(p( Wx ^(w). By the continuity of F we have 

dist (w; ^- 1 (F(w x ))) = dist (w; S(F(w\))) = \\w -w*\\, 
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which yields therefore that 

\\w-w*\\ = dist(u);$- 1 (F(u; A ))) < Xk F F(w). (3.23) 

Taking further a point w closest to w* in S, we get by (|3.ip and by part (i) above that 

\\w -w*\\< k F F(w*) = k F F(w x ) = k F (l - X)F(w). (3.24) 

Since w G S, the latter implies that 

dist (w; S) < \\w — w\\ 

< \\w — w* || + \\w* — w\\ (by the triangle inequality) 

< Xk F F(w) + (1 - X)k F F(w) (by (|3~23)l and ([3341 ) 
= fcj-F(w), 

which contradicts (|3.20[) and thus completes the proof of Step 2. A 

Step 3: condition measure via metric regularity. We have the equality 

k F = sup reg$(w,F(w)). (3.25) 

wen\s 

Proof. Let us first show that 

k F > sup reg$(w,F{w)). (3.26) 

wefi\s 

Assuming the contrary, find (w' , z') G gph_F, w' € f2 \ S satisfying 

reg$(u/,z') > k F . 

Observe that there exists a neighborhood of (w',z') such that for all points (w,z) in that neigh- 
borhood w £ S and z > 0. By the definition of metric regularity we can find w, z in such a 
neighborhood of («/, z') for which 

dist (w, <& _1 (z)) > feudist ($(w);z). 

The latter contradicts Step 1 and thus ensures ([3. 261) . 

To prove the opposite inequality in (|3.25p , by Lemma 13.21 find w €. Cl\S such that 

dist (w; S) = k F F(w). 

Let wq := Tls(w) and define 

w\ := w + X(wq — w), < A < 1. 

It follows from Step 2 that for every A G (0, 1) and the above choice of w we have 

dist^^-^F^))) _ A dist (w; S) _ 
dist(F(w A );$(u))) ~ XF{w) _ F ' 

The latter implies, since w\ — >• w and F(w\) — > F(w) as A 4- 0, that 

,_ /-xN dist(to;$- 1 (F(io A ))) 

rcg$(w,F(u;)) > hmsup v ' = k F , 

Aio dist {F(w\);${w)) 



which therefore yields 



k F < sup reg$(iy, F(w)) 

wen\s 



and completes the the proof of the theorem. A 
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3.2. Proof of Theorem [TT2J First of all, observe by Step 1 in the proof of Theorem 11.1 1 that 
the multifunction $ is metrically regular around (if, z) £ gph $ for every w £ ft \ S. Employing 
the corresponding results of Section [5J for (u>, z) £ gph$ with w E tt\S we get 

reg$(w,z) = \ip^>~ 1 (z,w) ( by Theorem 12. 2J) 

= \\D*$- l (z,w)\\ ( by Theorem El]) 

= || (£>*$(«;, z))~' ( by the definition of D*$(w, z)) 

= sup -. — -r ( by Proposition 12.51 with n = 1). 

This gives therefore the regularity exact bound formula 

rcg$fw z) = (3 27) 

v min{dist(0;£>*$(w,z)(-l)), dist (0;D*$O, z)(l))} ' 

Defined next a set-valued mapping F : M m+n =4 M by 

F(io) := [F(iy), oo) with gph F = epi F (3.28) 

and observe that it is Lipschitz-likc at every point of its graph, which is the epigraph of a Lipschitz 
continuous function. Furthermore, the graph of F is convex, and hence F is graphically regular at 
any point of its graph by Proposition 12.31 which also ensures the normal regularity of the convex 
set ft. Applying Proposition 12 .41 to the sum $ = F + 6q, we get the equality 

L>*$(w, z)(X) = D*F(w, z)(A) + Nn{w) for all A £ R. (3.29) 

It follows from the structure of F in ()3.28j) . the coderivative definition (|2.4j) . and the well-known 
subdifierciitial representation 

dip(x) = {t)£ M n \ (v,—l) £ N((x,tp(x));epi<p)}, x £ dom ip, 

for any convex function tp : M n — > M that 

D*F(w,z)(l) = l 1 F{W) > l^pfy] D*F(w,z)(-l) = Q>. (3.30) 

Combining (|3.2T[) . (|3.29[) . and (|3.30[) gives us the formula 

ieg$(w, z) = - ,,.,, , v (3.31) 

dist (0; dF(w) + Nn{w)) 

which is (fl~10| . A 

3.3. Proof of Theorem 11.31 . By Theorem 11.11 and Theorem 11.21 it suffices to show the 
following representations for dF(x,y) and N/^ mK \ n {x 1 y): 

dF(x,y) = co {(oi,6jfe) £ M m x M n \ i£l(x), k£K(y)}, (3.32) 

NA m xA n ( x > y) — span{l m } x span{l„} — cone [co {e_,-| j £ J(x, J/)}] . (3.33) 

Indeed, the classical subdifferential formula for max-functions (see, e.g., |19[ Exercise 8.31]) gives 



us 



<9( maxcTu;) = co {c/l i £ L, cjw = maxcTw). 
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This implies by the max-structure of the function F in (|1.4[) that 

dF(x,y) =co{(a t ,bk)\ i G I(x), k G A"(y)}, 

which is ([332]) . 

To prove p.33j) . we recall first the calculus formula 

N AnB (w) = N A (w) + N B {w) 

held at every w £ An B for arbitrary convex polyhedra in finite dimensions; see, e.g., |18[ Corol- 
lary 23.8.1]). Thus we have in our case that 

N a (w) = N {Eu=f} (w) + N {u > 0} (w). 

Moreover, it is easy to see that 

N {Eu=f} (w) = (kcrE) 1 - = span{l m } x span{l„}, 

N {u >o}{w) = -conc[co{ej \j G J{w)}]. 
Thus for any w = (x, y) G O = A„ x A TO we have 

NA m xA n {x, y) = span{l m } x span{l„} -cone [cojej \j G J(x,y)}], 

which is (pT33|) . A 

4. Condition measure formula via alternative proof. In this section we give another 
proof of Theorem II .31 based on convex optimization. This proof is split into three lemmas and the 
preceding technical claim. 

Given a point iiiGS!\S and keeping the notation above, consider the following two problems 
of parametric optimization (with the parameter z G M) defined by 

VJw) := min ||«j - w\\ V z (w) := min ||to - w\\ 

s.t. cjw < z V£el(w) and s.t. niax{c/w} = z 

Ew = f (P z ) £ Ew = f (Pz) 

Wj > Vj e J(w) w > 

and name (P z ) and (P z ) the first and second parametric problem, respectively. Observe that for 
every w £ fl \ S and z G M+ the optimal value V z (w) in problem (P z ) is equal to dist (w; S(z)). 
Although the proof of the following claim is straightforward, we provide it for completeness and 
the reader's convenience. 

Claim 4.1. (stability of optimal solutions to first parametric problem). For any w G 
Cl\S and any 7 > there is e > (depending on w and 7) such that whenever z G \F(w) —e, F(w)] 
a unique solution w z to problem (P z ) exists and satisfies the continuity property \\w z —w\\ < 7 with 
respect to the parameter z. 
Proof. Fix 7 > and put w := n,s(u)). Let 

W := w + t(w — w) with r := min < - — = — , 1 > G (0, ll. 

^ \\w b — w\\ J 

Setting e := F(w) — F(w), observe by the convexity of F that 

e = F(w) - F(w) > tF(w) > 0. 
15 



We have furthermore that 

Ew = Ew + t(Ew s - Ew) = /, 

Wj = (1 — t)wj + tw S j > for all j G J(w), and 

\\w — w\\ = t\\w — w\\ < 7, 

which imply the inclusion 

w G A := {w\ \\w — w\\ < 7, Ew = /, u>j > for all j G J'(w)}. 

Since the set A is obviously convex with w G A, we get 

w t := w + t(w ~ w) G A whenever £ G [0, 1]. 

It follows from F(w) = F(w) — e and the continuity of F that for every z G [F(w) — e, F (w)] there 
is t z G [0, 1] such that Wt. satisfies the equation 

F(w u ) = z. 

For any z from the above we easily get that w tz is feasible to problem (P z ), that the set of feasible 
solutions to this problem is surely closed and bounded, and that the cost function is continuous 
with respect to w. Thus (P z ) admits an optimal solution, which is unique as a unique projection 
of w on the convex feasible set. Finally, 

V z (w) = \\w z - w\\ < \\w tz - w|| < t z \\w - w\\ < 7, 

and hence the optimal solution w z belongs to the ball w + 1B 1 . A 

The next result, whose proof is based on Claims 13.11 and 14.11 indicates the parameter region 
on which the optimal values in the first and second parametric problems agree. 

Lemma 4.2. (optimal values agree for both parametric problems). Let w G \ S. 

Then there exists e^, G (0, F(w)) such that for every parameter z G \F(w) — £„>, F(w)\ the optimal 
values of problems (P z ) and (P z ) coincide. 

Proof. Fix w € \ S and observe that the set of feasible solutions for (P z ) obviously belongs to 
the set of feasible solutions for (P x )- Thus we have V z (w) > V z (w) for all z G JR. It remains to 
show that there exists e a > such that V z (w) < V z (w) whenever z G [F(w) — ew,F(w)]. 

Employing Claim [XT1 find 7 > for which T(w) C Z(w) and J7{w) C J{w) when w G w + IB 7 . 
Further, it follows from Claim 14.11 that for such 7 there is e > with the property: whenever 
z G [F(w) — e, F(w)] there exists a unique solution w z to problem (P z ) satisfying w z G w + IB^. 
Our choice of 7 ensures the feasibility of w z in problem (P z ), and therefore we have the relationships 

V z {w)<\\w z -w\\ = V z {w), 

which thus complete the proof of the lemma. A 

Lemma 4.3. (distances to solution sets). For every w G fl\ S denote z w := F(w) — e w 
with e w taken from Lemma H.'Il Then we have 

dist (w-S(z w )) dist(w;5) IA ,. 

sup j— = sup -. — r — . (4.1) 

wen\s F(w) - z w wen \ s F(w) 
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Proof. Fix w £ \ S and z £ (0, F(w)), and then let 

__ dist(w;5(z)) 
*^'^- F( W )- Z • 

We first justify the inequality 

sup k(w,z w )< sup fe(w,0), (4-2) 

toeO\S wei!\s 

which gives the one in (|4.1[) . Pick any w £ O \ 5, let i/7 S := argmin^gs ||w — w\\ and 

w t := (1 - t)w s + tw, t£[0, 1]. 

Since ztu G (0, F(u))), there is r £ (0, 1) with F(w T ) = z a . By the convexity of F we have 

Ztf = F{w T ) < (1 - r)F(w s ) + tF(uj) = tF(w). (4.3) 

Further, it follows from w T £ S(zw) that 

dist(rZ);5(zfii)) < \\w - w T \\ = (1 - t)\\w s - w\\ = (1 - r)dist (w;S). (4.4) 

Combining (|4.3f> and (|4.4[) gives us 

dist {F(w);z iS ) (l-T)F(w) 

which yields (|4.2p and thus the corresponding inequality in (|4.1|) . 
It remains to show that 

sup fc(ti), z w )> sup fe(w,0), (4-5) 

w6f!\S «iSfi\S 

which ensures the equality in ()4.1| . By Lemma 13.21 we have that kp = sup^gm 5 fc(io, 0) and that 
the maximum is attained at some w £ Cl\ S. Given z £ (0, F(w)), let 

w z := arg min \\w — w\\ 
weS(z m ) 

and observe the estimate 

dist (w; S) < \\w — w z \\ + dist (w z ; S), 

implying in turn that 

, / \^,/- \ II* - w **> II ^ dist i™'' S ) ~ dist ( w z a ; S ) 

sup k(W,Z w ) > k{W,Zjjj) = TTT^ ^ F7^ ■ 

wea\s F { w ) ~ *w F{w) - z m 

On the other hand, we have the equality dist (w; S) = F(w)k(w, 0) by the definition of k(w, z) and 
also the relationships 

dist (w Za ; S) = F(w Za )k(w z<!1 , 0) < z m k{w, 0) 

due to F(w Za ) = Zw and k(w, 0) = sup we Q\gk(w,0). Thus 

, / . F(w)k(w,0) - z m k(w,0) ,_ , . 

sup ft(u;,z ro )> _ = k{w, 0) = sup fc(w,0), 

wen\s F(u») — z™ ro en\s 
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which justifies (|4.5[) and completes the proof of the lemma. A 

The last lemma establishes, by employing Lagrangian duality, a precise formula for computing 
the optimal value of the cost function in the parametric problem (P z ) — and hence in (P z ) — via the 
initial data. 

Lemma 4.4. (computing optimal values of parametric problems). Let w € fi \ S and 

z G (0,F(w)). Then the optimal value V z (w) of problem (P z ) is computed by 

yj-s = F(W) - Z 

dist (0;co{ci,i G I(w)} + (ker E) 1 - - cone [co{ej, j £ J(w)}]) 
Proof. Observe that problem (P 2 ) can be reformulated as 



u T (w — w) + yj Xi(cjw — z) + v T (Ew — f) — 2_, Mj ? 



V z (w) = inf sup 

INI < 1, i£i(w) jej(w) 

Xi >0,i el(w), 

v e fi m , 

l*j >0,j €j(w), 

^ = 0,jeJ\J(w) 

Observe that the convex optimization problem (P z ) satisfies the Slater condition: For 5 G (0,1) 
sufficiently small and w € S, the point (l — d)w+6( — l n , — l m ) is a strictly feasible point. Therefore, 
we can interchange the supremum and the infimum above by Lagrangian duality. This gives 



T/ 

u (w — w 



V z (w) = sup inf 

Nl < i, 

X, >0,i el(w), 

v G R m , 
Hj>0,j€j(w), 

ii,=o,jeJ\J(w) 

Regrouping the terms inside the square brackets, we obtain 



)+ J2 K(cJw-z) + v T (Ew~f)- Y, AW 



u + 2, ^i c i + E v — /j, \ w — u w — 2_, ^i z — v f 

iex(w) I iei(w) 



V z (w) = sup inf 

IMI<i, 

K >0,i Gl(w), 
v G R m , 

to >o,jej(w), 

(i j =0,j£j\J(w) 

Observe further that, whenever the term (w+X^GXte) XiCi+E v—fi) is not zero, the inner infimum 
in w necessarily becomes — oo. This allows us to put 

U = — 2_, ^i C i ~ E V + [1 

iei(w) 
and consequently rewrite the expression for V z (w) as follows: 



V z (w) 



£ 





/ 




sup 

ex(tD) x i°i + eTv ~ Mil < 1, 
Xi > 0,i £l(w), 


^ X lCl + E T v- 

\i£X(w) 


-/' 


lij >0,j€j(w), 
Hj = 0,j£j\J(w) 







i£X(w) 



LS 



Regrouping again gives us the formula 



V z (w) = sup 

II EiEZfrB) >*<* + ET V ~ Mil < 1, 

A, >0,i £l(w), 
Hj>0,j€j(w), 



^2 ^ ( c Jw - z )+ v T (Ew - f) - n T w 

ieX(tD) 



Noting that Ew = /, /jL T w = and cjw = F(w) for i s I(w), we have 

K(w) = (F(tS) - z) sup ]T A,. 

II E; e x(™) A * c * + ^ - Mil < 1, <ex(«) 
A, > 0,i el(w), 

Mj = o,ie J\J(w) 

Since Vz(w) 7^ 0, the latter yields 
V z {w) = {F(w) - z) 



sup 



E, 



AiCi 



£ J 



\i>0,i el(w), 
Hj=o,jej\j(w) 



A, 



< 



12 ieX (vi) A » 



V z_/iei(ts) A * 



which can be written as 

V z (w) = (F(w) - z) 



sup 

Mj >o,iey(w), 
ft = o,jeJ\J(w) 



1 










,A, 


A» 




E«ex(ffi 


,A, 



Changing further the variables by 
A, 



E 



iex(u)) Al 



E, 



6X(i 



E, 



ex(-ffi) ' 



we arrive at the expression 

V 2 {w) = (F(w) - z) 



sup 
Xi >0,i &T{w), 

Ejei(tB) Ai = 1, 

Ji j = 0,jGj\J(w) 



Eiex(tD) *i c i + ETv - M 



which can be equivalently written as 
V z (w) = 



F(w) - z 



inf 



Xi > o,i ei(iij), 

Eiei(io) ** = ^j 

Mi >0,jeJ(w), 

Mj =0,j£j\J(«i) 
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E ie x(<B) A i c * + ^ Tw ~ M 



Recalling the notation of Section 1 allows us to reduce the latter expression to the one in the 
lemma formulation and thus finish the proof. A 

Combining the obtained lemmas with the definitions above, we can now complete the alterna- 
tive proof of the condition measure formula in Theorem 11.31 

Proof of Theorem 11.31 For every w G 51 \ S choose the parameter z w as in Lemma l4~3] i.e., put 
z w = F(w) — e w , where e w is taken from Lemma 14.21 Then we have 

k F = inf {k > 0| dist (w; S) < kF(w) for all w efl\S} (by definition ([53])) 
dist (w;S) , _, . _, . n . 

= sup ) (asn\s^<$) 

dist (w; S(z w )) 

= sup — (by Lemma 1473]) 



u£Q\S F (w) ~ z u 

= sup z ™ (by the definition of (P' z )) 

■wen\s F(w) - z w 

= sup — -r^f (bv Lemma 14.21 and the choice of z,„) 

wen\s F M - z w 

= sup — -, — — r — -TY (by Lemma 14.41) . 

we n\s dist {0]co ie x( w ){cei + {kerE) J - - cone l<x>jGj(w){ejt\) 

Letting w = (x,y) G £1, observe finally that 

{d\ £ G l(w)} = {(ai, 6as)| i e I(x), k e K(y)}, (kcrE) 1 - = span{l„} x span{l m }, 

and k(A) = kp, which complete the proof of the theorem. A 
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